nm  niE  cow 


CCC  ^HfMft^eOCUMENTATION  PAGE 

AD-A200  bbD  >  1 1  j lib.  RESTRICTIVE  MARKINGS 


:lectej 


iumhON  A 


2b  DECLASSIFICATION  /  DOWNGRA 


4.  PERFORMING  ORGANIZATION  REPORT  NUM8ER(S)| 


|  3  DISTRIBUTION/  AVAILABILITY  OF  REPORT 

Approved  for  public  rel 

J  ■  l  •  t  I .  , ,  .  / 

”rviT:rt:i  nr, 


0RGANI2AT10W  lRW"0RT  NUMBER(S) 

SR-TK.  88  -  l  ,  j  , 


5  MONiT 


6a  NAME  OF  PERFORMING  ORGANIZATION  6b  OFFICE  SYM80L  7a  NAME  OF  MONITORING  ORGANIZATION 
rtni w^rsitv  of  Maryland  (if  applicable)  AFOSR/NM 


University  of  Maryland 


6c.  ADDRESS  (City,  State,  and  ZIP  Code) 
College  Park,  MD  20740 


8a.  NAME  OF  FUNDING  /SPONSORING 
ORGANIZATION 
AFOSR 


7b  ADDRESS  (City,  State,  and  ZIP  Code) 
AFOSR/NM 
Building  410 

Bolling  AFB ,  DC  20332-6448 


8b  OFFICE  SYMBOL  9  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 
(If  applicable ) 

NM  AFOSR-87-0287 


10  SOURCE  OF  FUNDING  NUMBERS 


PROGRAM  I  PROJECT 

ELEMENT  NO  I  NO. 


8c.  ADDRESS  (City,  State,  and  ZIP  Code) 
AFOSR/NM 
Building  410 

Bollinq  AFB,  DC  20332-6448 


11  TITLE  (Include  Security  Classification) 

Applications  of  Operator  Theory  to  Maximum  Entropy  Problems 


WORK  UNIT 
ACCESSION  NO 


C/i02f 


12  PERSONAL  AUTHOR(S) 

Lay,  David  C. ;  Ellis,  Robert  L.;  Gohberq/  Israel 


13a.  TYPE  OF  REPORT 
Annual 


13b  TIME  COVERED  /  14.  DATE  OF  REPORT  (Year,  Month,  Day)  15  PAGE  COUNT 

from  87-6-15  roQS-6-14  88^7-8  8 


COSATI  CODES 


SUB-GROUP 


18  SUBJECT  TERMS  (Continue  on  reverse  if  necessary  apd  identify  by  block  number)  , 
operator  theory,  matrix  theory,  maximum  entropy  principle, 

extensions  df  band  matrices,  Toeplitz  matrix,  orgothogonal 

polynomials,  negative  eigenvalues,  signal  processing,  model 


19  ABSTRACT  (Continue  on  reverse  if  necessary  and  identify  by  block  number )  J1  '  „ 

This  project  is  focusing  on  problems  in  operator  theory  and  matrix  theory  that 
underlie  the  maximum  entropy  principle  in  signal  processing  and  system  theory.  We  have 
found  generalizations  of  this  principle  for  finite-dimensional  problems  to  certain 
broad  classes  of  hermitian  band  matrices,  including  Tceplitz  matrices,  and  we  have 
shown  why  a  similar  principle  cannot  exist  for  all  hermitian  band  matrices. 

Zeros  of  orthogonal  polynomials  are  studied  in  a  setting  that  generalizes  the 
usual  minimum  phase  theorem  for  the  error  prediction  filters  related  to  stationary 
time  series.  In  another  paper,  we  analyze  the  number  of  negative  eigenvalues  of  an 
extension  of  a  hermitian  band  matrix  in  terms  of  the  entries  in  the  band  matrix. 

From  this  we  obtain  results  on  maximum  entropy  and  on  singular  values  of  extensions  of 
triangular  matrices.  The  latter  results  are  related  to  the  finite-dimensional  model 
reduction  problem  for  linear  systems.  . 


20  DISTRIBUTION /AVAILABILITY  OF  ABSTRACT 

□  UNCLASSIFIED/UNLIMITED  □  SAME  AS  "PT  Uu.,u  USERS 


22a.  NAME  OF  RESPONSIBLE  INDIVIDUAL 
Major  Brian  Woodruff 


OO  FORM  1473,  84  MAR  89  APR  edition  may  be  used  until  exhausted 

All  other  editions  are  obsolete 

88  1011  15  f 


22b  TELEPHONE  (Include  Area  Code)  22c  OFFICE  SYMBOL 

(202)  767-5027  NM 


SECURITY  CLASSIFICATION  OF  THIS  PAGE 


unclassified 


AFOkK-'I*.  8  8  -  )  j  J  1 


1988  ANNUAL  REPORT 

t 

AFOSR  GRANT  87-0287 


APPLICATIONS  OF  OPERATOR  THEORY  TO  MAXIMUM  ENTROPY  PROBLEMS 


REPORT  ON  COMPLETED  WORK 


This  project  is  concerned  with  problems  in  operator  theory  and  matrix 
theory  that  underlie  the  maximum  entropy  principle  in  signal  processing  and 
system  theory.  We  have  found  generalizations  of  this  principle  for  finite- 
dimensional  problems  to  certain  broad  classes  of  selfadjoint  band  matrices, 
and  we  have  examined  some  cases  in  which  a  maximum  entropy  principle  exists 
only  as  a  constrained  maximum.  Our  work  in  [2]  makes  it  clear  why  a  maximum 
entropy  principle  cannot  exist  in  all  cases:  in  general  the  band  extension  of 
a  selfadjoint  matrix  is  only  a  stationary  point  for  the  determinant  function, 
and  can  yield  a  maximum,  a  minimum,  or  a  saddle  point. 

For  Toeplitz  matrices,  however,  the  indefinite  selfadjoint  case  is  close 
to  the  positive  definite  case  that  arises  in  signal  processing  and  other  situ¬ 
ations  involving  stationary  stochastic  processes.  In  order  to  state  one  such 
result,  we  need  some  definitions.  An  nxn  matrix  R  is  called  an  m-band  matrix, 
where  1  £  m  £  n-2,  if  the  entries  r^j  in  R  satisfy  r^  =  0  for  |i-J|  >  m.  An 
extension  of  R  is  an  nxn  matrix  whose  entries  agree  with  those  of  R  inside  the 
band  | 1 — J |  <1  m.  A  band  extension  of  R  is  an  invertible  extension  F  of  R  such 

that  F  1  is  again  an  m-band  matrix.  Finally,  we  let  R(J . k)  denote  the 

submatrix  of  R  consisting  of  the  entries  r  _  such  that  j  <  a,0  <  k.  The 
result  is  as  follows: 

Suppose  that  R  is  a  selfadjoint  Toeplitz  m-band  matrix  such  that 
det  R(l,...,m)  >  0  and  det  R( 1 , . . . , m+1 )  >  0.  Then  R  admits  a  unique  band 


extension  F,  the  matrix  F  is  Toeplitz,  and  F  is  characterized  by  a  maximum 
entropy  principle  for  matrices  in  the  sense  that,  if  G  is  any  selfadjoint  (but 


not  necessarily  Toeplitz)  extension  of  R  such  that  det  G(l,...,k)  >  0  for 
k  =  m+2 . n,  then  -  -  -  - 


with  equality  only  if  G  =  F. 


det  G  <  det  F, 
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A  continuation  of  our  work  in  [2]  appears  in  [3].  Here  we  analyze  the 
number  of  negative  eigenvalues  of  an  extension  of  a  selfadjoint  band  matrix  in 
terms  of  the  entries  in  the  band  matrix  and  the  nature  of  the  extension. 
Applications  are  given  to  Toeplitz  matrices  and  to  maximum  entropy.  We  also 
study  the  problem  of  determining  the  size  of  the  singular  values  of  an  exten¬ 
sion  of  a  lower-triangular  matrix.  As  we  mentioned  in  our  proposal,  this  has 
connections  with  the  finite-dimensional  model  reduction  problem.  Our  results 
in  [2]  and  [3]  reveal  certain  difficulties  associated  with  infinite- 
dimensional  generalizations,  and  we  plan  to  explore  these  difficulties  in  the 
near  future. 

The  results  in  [2]  and  [3]  for  finite  Toeplitz  matrices  and  our  plans  for 
infinite-dimensional  generalizations  led  to  the  problem  of  the  distribution  of 
the  zeros  of  polynomials  that  are  orthogonal  on  the  unit  circle  with  respect 
to  an  indefinite  inner  product.  This  topic  is  connected  to  signal  processing 
in  the  following  way.  Let  f  be  the  power  spectrum  of  a  single  channel 
stationary  complex  time  series.  Then  f  is  a  positive  real-valued  function  on 
C  — 7t,  Tt  ] .  Denote  the  jth  Fourier  coefficient  of  f  by  c  .  Define  an  inner 

J 

product  on  the  space  of  complex  polynomials  by 

<p,q>  =  J  f (0)p(ei0)q(ei0)  de  (1) 

-n 

for  polynomials  p  and  q.  Equivalently,  if  n  is  the  larger  of  the  degrees  of  p 
and  q,  and  if 
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Suppose  that  complex  numbers  x  ,  ....x^,  with  xq  *  0,  satisfy 


and  let  f  (z)  =  x  z"  +  .  .  .  +  x  .  Then  f  is  called  the  nth  orthogonal 

A  O  n  n 

polynomial  on  the  unit  circle  with  respect  to  the  inner  product  (1).  An 
important  property  of  f  is  that  its  zeros  all  lie  inside  the  unit  circle  in 

n 

C.  In  signal  processing,  f  (up  to  a  scalar  multiple)  is  sometimes  called  the 
nth  order  backward  error  prediction  filter,  and  a  variant  of  (2)  is  refered  to 
as  the  Yule-Walker  equations.  The  uses  of  such  orthogonal  polynomials  in 
signal  processing  are  described  in  the  survey  article  [6]. 

Suppose  that  the  function  f  in  (1)  is  nonzero  but  not  necessarily  posi¬ 
tive.  In  this  case  (1)  determines  an  indefinite  inner  product.  Orthogonal 
polynomials  may  be  defined  as  before.  In  [7],  M.  G.  Krein  stated  the  following 
remarkable  characterization  of  orthogonal  polynomials:  A  polynomial 

.  .  ,  n  n-1 

f  ( z )  =  X_Z  +  X, Z  +  .  .  .  +  X  , 

n  0  1  n 

with  Xq  *  0,  is  the  n-th  orthogonal  polynomial  on  the  unit  circle  for  some 

indefinite  inner  product  (1)  if  and  only  if  x^  is  real  and  f^  has  no  zeros  on 

the  unit  circle  and  no  pair  of  zeros  that  are  symmetric  with  respect  to  the 

unit  circle.  We  have  supplied  in  [4]  a  new  proof  of  this  result  that  contains 

an  explicit  formula  for  the  Fourier  coefficients  of  the  weight  function.  In 

addition,  we  have  provided  a  transparent  proof  of  another  theorem  in  [7]  that 

describes  the  number  of  zeros  of  f  that  lie  inside  the  unit  circle.  This 

n 

theorem  generalizes  the  standard  minimum  phase  theorem  for  error  prediction 
filters.  Some  generalizations  of  Krein’ s  results  are  also  presented.  Our 
proofs  make  essential  use  of  the  properties  of  one-step  extensions  of  self- 
adjoint  Toeplitz  matrices  we  developed  earlier  in  [2].  Our  work  in  [4]  has 
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led  to  generalizations  of  the  theory  to  block  matrix  orthogonal  polynomials. 
See  the  paper  in  [5]. 

Related  work  on  interpolation  problems  for  rational  matrix  functions  will 
appear  in  [1].  In  this  paper  some  basic  interpolation  problems  are  treated 
from  a  unified  point  of  view.  Included  is  the  problem  of  reconstructing  a 
rational  matrix  function  from  its  null  and  pole  data,  and  the  problem  of 
constructing  a  unitary  rational  matrix  function  when  only  a  part  of  the  null 
and  pole  data  is  given.  Problems  of  Nevanl ina-Pick  type  are  also  considered 
The  solutions  of  these  problems  are  given  in  an  explicit  form,  within  the 
framework  of  realization  theory  and  finite-dimensional  matrix  analysis. 


WORK  IN  PROGRESS 

A  limiting  case  of  maximum  entropy  spectra  of  stationary  time  series 
occurs  when  the  power  spectrum  consists  of  a  set  of  pure  line  spectra  and  the 
time  Function  is  a  sum  of  pure  frequencies.  In  this  case  the  autocorrelation 
matrix  is  singular  for  n  >.  N,  and  (2)  becomes 
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If  has  rank  N,  then  the  problem  of  extending  the  matrix  to  a  larger  nxn 

matrix  (which  is  equivalent  to  determining  the  higher  Fourier  coefficients  of 

the  spectrum  f)  is  related  to  the  problem  of  enlarging  T..  to  an  nxn  matrix  T 

N  n 

in  a  way  than  minimizes  the  rank  of  T  . 

n 

Currently  we  are  working  on  the  problem  of  extending  a  band  matrix  (not 
necessarily  Toeplitz  or  even  selfadjoint)  in  a  way  that  minimizes  the  rank  of 
the  extension.  It  appears  that  the  minimum  rank  criterion  is  dual  in  some 
sense  to  the  maximum  entropy  criterion. 

We  are  also  working  on  infinite-dimensional  problems  along  the  lines 
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described  in  the  research  proposal. 


ACTIVITIES  OF  THE  INVESTIGATORS,  1987-1988 

During  the  Fall  semester  of  1987  we  conducted  a  working  seminar  on 
operator  theory.  The  material  in  the  seminar  focvsed  on  problems  connected 
with  our  proposal.  Many  lectures  were  presented  by  Israel  Gohberg  and  Joseph 
Ball,  both  of  whom  spent  a  sabbatical  semester  visiting  the  University  of 
Maryland.  The  average  attendance  was  20,  with  nearly  equal  number  of  faculty 
members  and  graduate  students. 

Israel  Gohberg  is  now  in  the  process  of  writing  with  Joseph  Ball  and  Leiba 
Rodman  a  book  on  interpolation  problems  for  rational  matrix  functions. 

During  the  Spring  semester  of  1988,  Robert  Ellis  and  David  Lay  were  on 
sabbatical  leave.  Ellis  spent  time  in  Amsterdam  and  Tel  Aviv,  working  with 
Gohberg,  and  gave  lectures  on  our  work  at  six  universities  in  The  Netherlands, 
Germany,  Greece  and  Israel.  Lay  attended  a  course  in  signal  processing,  gave 
several  lectures  on  our  work  and  attended  the  SIAM  Conference  on  Applied 
Linear  Algebra  in  Madison,  Wisconsin,  and  a  four-day  conference  on  Matrix 
Spectral  Inequalities  at  Johns  Hopkins  University. 

For  ten  weeks,  beginning  the  first  of  June,  1988,  we  are  conducting  a 
working  seminar  on  rational  matrix  functions  and  connections  with  the  theory 
of  linear  systems.  The  seminar  meets  4  to  5  hours  per  week.  During  this 
period  several  research  associates  will  be  participating,  in  addition  to 
Ellis,  Lay,  and  Gohberg: 

Prof.  Harm  Bart  -  2  months 

Erasmus  University,  Rotterdam 
Prof.  Reinhard  Mennicken  -  1  day 

University  of  Regensburg,  West  Germany 
Prof.  Boris  Reichstein  -  1  week 

Catholic  University,  Washington,  D.  C. 

Prof.  Rien  Kaashoek  -  3  weeks 
Free  University,  Amsterdam 


Reports  of  our  research  at  conferences  has  stimulated  considerable 
interest  in  the  problems  we  have  described,  and  several  otner  researchers  are 
investigating  related  topics. 
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